"The highlighted tokens are predominantly function words, particles, and grammatical markers in Thai (and some in Hindi), such as those indicating possession, location, comparison, or subordination, as well as common pronouns and auxiliary verbs. These tokens play a crucial role in sentence structure, linking, and meaning, often marking relationships between clauses, objects, and actions. Their high activation suggests their importance in parsing and understanding the syntactic and semantic framework of the sentences."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.77 | 0.846 | 0.66 | 0.742 | 0.66 | 0.88 | 0.12 | 0.34 |
fuzz | 0.78 | 0.804 | 0.74 | 0.771 | 0.74 | 0.82 | 0.18 | 0.26 |